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IDENTIFIERS 
ABSTRACT 

This Study examined the effects of the type of 
adjunct questions (use-a-generality , remember-a-generality , and 
renenber-an- instance) and the position of these questions either 
before the relevant text passage (pre-questions) or after it 
(post-questions) on the three corresponding performance levels of 
learning. The subjects were 74 eighth-'grade students at a suburban 
school in Syracuse, New York, and the materials for the learning task 
consisted of an approximately 450-word passage selected from a social 
studies textbook for this grade level. Six different treatment groups 
were used, with each group receiving adjunct questions which varied 
as to performance level and placement of the questions. The results 
were analysed separately for each level of performance as well as for 
the total test score. None of the effects reached significance for 
any of the subtests. These results suggest that, in order to optimize 
learning, the position of the adjunct questions must be taken into 
account as well as the type of question to be used. An 18-item 
reference list is provided. (RP) 
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ABSTRACT 



Stventy-four nale «nd female eighth-grade students were 
pcesented with a 450~word passage froB a social studies 
textbook. Three types of adjunct questions were placed either 
before or after the relevant passage. They wecei 1) 
ReMaber*an-instance (RZ) questions requiring students to 
recall a specific inforBation» 2) reneaber-a-generality (R6) 
questions requiring students to recall the stateaent of a 
general idea» such as a concept » principle » or procedure} and 
3) use-a<-generality (OG) questions requiring students to apply 
the generality to new situations they have not seen before. On 
the nine short-answer posttest questions, which were conprised 
of these three types of learning (RI» RG» 0G)» no significant 
Min effects were found. Only a significant interaction 
between type and position of adjunct questions was found. This 
interaction indicates that use-a-generalitly adjunct questions 
led to superior performnce when they were placed itttL the 
relevant passage^ whereas the resesdber-an-instance adjunct 
questions led to superior perforaance» when they were placed 
taftfficft the relevant passage. This result suggests that during 
Instruction not only the type of adjunct question should be 
taken into account » but also the position of that type of 
question. 
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Two of the aims o£ instruction are to promote thinking and 
improve students* learning* and asking questions during 
learning is one way to accomplish these ends (Rothkopf , 1966 j 
Rothkopf and Bisbicos, 1967; Prase, 1967, 1968) Yost, Avila and 
Vexler, 1977). Researchers have studied adjunct questions in 
terns of type and position. Typea of adjunct questions have 
prinarily been ■emorig««;4on-iftv#i questions, which ask about 
specific previous infornation, and a pplication-level questions, 
which require applying the previous information to new 
situations. 

Kenorization-level questions can be further classified as 
two typest recognition questions, such as a uultiple-choice 
question about specific infornation (e.g., Which of the 
following is the capital of the U.S.A.?) contained within the 
instructional naterial) and recall questions, such as a 
constructed-response or f ill-in-the-blank question about such 
Information (e.g., what is the captial of the U.S.A.?). 
Corresponding to these two types, application-level questions 
can require the learner either to identify a new example, such 
as a multiple-choice question about an instance that the 

^^yS &?j&«...fSS" i^A^" Which of the following 

pictures are pictures or manmal8?r; or to produce a new 

example, such as a constructed response question that requires 

the students to create a prediction or a solution to a problem 

that they have not seen before (e.g., *solve this problem by 

using a principle you have just learned"). 

Poaitlon of adjunct questons is usually classified in 
terms of whether the questions are inserted before or after the 
instructional material (or both before and after). 

ZyStft a£ Adjunct Om>gtlnnfl 

With respect to type of adjunct questions, some research 
studies have found that questions which require students to 
a£BiX the principles or concepts described in a passage can 
give more effective learning than questions which require 
students to remember this kind Of content. For example. Watts 
and Anderson (1971) found that subjects who received questions 
requiring them to apply principles just covered to new examples 
performed significantly better on the posttest (which contained 
both recall and application questions) than did subjects who 
received adjunct questions requiring them to recall previous 
examples. Felker and Dapra (1975) also found that subjects who 
received application-level adjunct questions requiring them to 
identify new examples of either concepts or principles 
performed significantly better on an application-level posttest 
than did either the group which received questions requiring 
them to recall the text verbatim or the control group which 
received no adjunct questions during instruction. Felker and 
Dapra also found that application-level adjunct questions 
resulted in better problem solving than did verbatim questions 
(asking students to recall exact text woros) . 



By using another kind of criterion, Rickards and DiVesta 
(1974) found that students who received questions on meaninyfui 
learning which required subsumption or organization of facts 
under given ideas, perfornod better than students who received 
questions requiring then to recall specific facts or ideas 
(rote learning of ideas and facts) on a postteot containing 
this kind of learning. 

However, some other studies have failed to sustain these 
results. Andre et al. (1980) found that out of seven studies 
which investigated the effects of adjunct questions on 
application and recall levels, five studies found no 
significant differences between factual questions and 
application questions on posttests including these two kinds of 
learning. The other two studies found a superiority for 
factual adjunct questions. Hence, type of adjunct questions 
seems to have had an inconsistent nain effect on learning. 
This inconsistency could possibly be resolved by looking at the 
position of adjunct questions. 

Position fi£ Adilinfit Oueflt^ong 

With respect to position of adjunct questions Rothkopf 
(1966) and Rothkopf and Bisbico (1967) found that questions 
which were presented after the relevant text passage had 
apparently both an ini-AnMonai (direct) learning effect in 
which the content learned was addressed by adjunct questions 
during instruction, and an incidant^ai (indirect) learning 
effect in which the content learned was not addressed by 
adjunct questions during instruction. 

Prase (1967, 1968) also found that students who received 
adjunct questions A£tfi£ the relevant passage performed better 
on the posttest containing both intentional questions and 
incidental questions than did students who received adjunct 
questions bfiffilfi reading the relevant passage. Sagaria and 
DiVesta (1978) supQorted Prase's results. In contrast, 
Rickards (1976) found that conceptual prequcstions produced 
higher recall than conceptual postquestions on a posttest 
containing conceptual questions. 

Hence, position of adjunct questions also has had an 
inconsistent main effect on learning. The inconsistent effects 
of both type and position of adjunct questions could possibly 
be resolved by considering the interaction between type and 
position of adjunct questions. In other words, one type of 
adjunct questions may be more effective than the other type 
when the questions are presentee after the reading passage but 
not when they are presented before it, and vice versa. 

Interaction bgfew»en zysL and PoBition q± ouQctio ns 

Rickards (1976) found that typo and position of adjunct 
questions Interacted to a significant degrees only recall-level 



pOBtquestiOM (which required students to recall specific^ 
previous inforaation) were superior to the control group on the 
inoMdiatef free-recall test* whereas on the delayed, 
fre««recall test» only conceptual prequestions (which require 
abstraction of the material) were superior to the control 
group. 

Andre et al. (1980) also found (in their experiment number 
1) a significant interaction between type and position of 
adjunct questions. when questions came after the relevant 
pages » application questions led to superior performance » but 
when questions came before the relevant pages » name (or memory) 
questions led to superior performance. In contrast » they also 
found opposite results in experiment number 2: they found an 
interaction which indicated basically that performance was 
better on name questions when those questions came after the 
relevant text than when they preceded it» while the effects of 
application questions did not differ with their position. They 
also found in their experiment number 3 that performance on 
application questions was better when those questions were 
inserted before the text» whereas performance on name questions 
was better when they were inserted after the text. 

LCYClB fi£ teaming 

As can be seen from the above studies on the interaction 
of type emd position of adjunct questions » the results are 
still inconsistent. But previous studies have used application 
and recall measures as dependent variables without 
distinguishing between different levels of remembrance. It 
seems possible that the effects of type and position of adjunct 
questions might vary depending on the level of learning. 
Hence » it was decided that this study should investigate 
different levels of learning (as distinct dependent variables) » 
as well as the interaction between the type and the position of 
adjunct questions. 

Several taxonomies of levels of learning have been 
developed (see e.g.» Bloom» 1956; Gaijne» 1979; Guilford, 1959; 
UunKins, 1972; and Merrill, in press). Of these, we suspect 
that Merrill's taxonomy of levels of learning may be the most 
useful one for prescribing the type and position of adjunct 
questions, primarily because of its identification of different 
levels of rememberance. 

Merrill (in press) distinriuishes among four major levels 
of cognitive processing and hence four major levels of 
learningt f ind->a-generality (FG), use**a~generality (UG) , 
remember-a-generality (RG) , and rentember-an- instance (RI). The 
f tnd-a-ggnarailty (pG) level Is that performance level which 
requires the learner to derive or invent a new rule (e.g., to 
derive a new principle from a set of examples) . The 
uge»a«»Qen»rai \ fy ([jQ) level requires the learner to apply some 
rule to a specific case that he or she did not encounter in the 
instruction (e.g., "Classify this new cell, which was not 
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presented before^ as an aninal cell or a plant cell"). The 
remeaber««-qeneral ii;y (R6) level requires the learner to search 
his or her aenory in order to recall or recognize a rule (e.g.* 
*frhat is . the definition of aninal cell?"). Finally, the 
geiiie«ber-an-tn«»^npg (RI) level requires the learner to recall 
or recognise soiae specific information (e.g., "V7hat is the name 
of the apparatus that we just discussed?"). 

Because of its lack of relevance to the level of learning 
of a»st prose naterials, the find level was not investigated in 
the present study. Using Merrill's taxonomy of perfornace 
levels to clarify the nature of adjunct questions, this study 
investigated three aajor questions related to the effects of 
adjunct questions i 

1. Hhat type of adjunct questions (UG, RG, RD meet facilitates 
learning? 

2. Hhat position of adjunct questions (pre or post questions) 
most facilitates learning? 

3. Is there an interaction between type and position of adjunct 
questions? 

HypothftBftB 

The sain purpose of this study was to examine the effects 
of tSOit of adjunct questions (use-a-gcnerality, 
renember-a-generality, and remember-an-instance) and the 
pnnition of adjunct questions (pre and post questions) on the 
three perfornance levels of learning. Therefore the following 
hypotheses weie investigated t 
1a XXBft fi£ questions - perforwance level 

a. Remenber-an- instance adjunct questions v;ill facilitate 
learning on the reneaber-an-instance level more than on the 
remember-a-generality or the use-a-generality level: 

RI — > RI > RG > UG. 

b. Remember-a-generality adjunct questions will facilitate 
learning on the remember-a-gcnerality level more than on the 
use-a~generality or remember-an- instance level t 

RG — > RG > UG > P.I. 

c. J.c~a-generality adjunct questions will facilitjtc learning 
on the use-a-gencrality level more than on the 
remember-a-generality or remember-an-instancc level t 

UG — > UG > RG > RI. 
2a POBltiOn Oi quefltlons 

a. Pue questions will facilitate learning on the 
remenber^an-instance and reroember-a-generality levels more 
than on the use-a-generality levels 

Pra — > RI • RG > UG 

b. Post questions will frcilitate learning on the 
use-a-generality level more than on the 
reBember-a'-generality or remember-an-instance level: 

Post — > UG > RG » RI 
1a Zypfi And poattion ol gugBfrinne (intecactionl 
a. Remember level questions will facilite learning more when 
used as pre questions than as post questions, whereas 
application level questions will facilitate learning more 
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when used as post questions than as pre questions: 
pre RI — > best on Ri outcome 
pre RG > best on RG outcome 
post UG — > best UG outcome 



Subjects 

The subjects were 74 eighth grade males and females at a 
suburban school in Syracuse » Dow York. They were primarily 
from middle-class homes. They were informed that the learning 
task was a part of their regular course requirements. The 
students were assigned randomly to six treatment groups. 

The design of this study was a two- way analysis of 
variance factorial design (3x2) . The factors were (1) t^SA of 
adjunct questions (Rl, RG» UG) and (2) poBifcion of adjunct 
questions (pre and post) . Post hoc multiple comparisons were 

HSfeipft-^RaWi TmwmhtUhtiih ^^ii^kPs^k^^ ?ffisf?'" 

Matgriala 

The materials for the learning task consisted of 
approximately a 450-word passage which was selected from a 
social studies textbook for eighth graders. The passage 
discussed the idea of Pan-Africa (a united Africa for all 
countries of the continent), and it gave some generalities 
(e.g., Nkrumah's tribe named their children for their birthday) 
and some examples (e.g., Saturday is the meaning of Nkrumah's 
name). There were three different sets of adjunct questions 
(UG, RG, and RI), and they were inserted either before or after 
the passage. Three short-answer adjunct questions vrerc written 
on the use-a-generality level. These questions were inserted 
either before or after the passage for the respective 
treatments (UG pre questions and UG post questions) . Such a 
question, for example, might ask: If you were born in Mkrumah's 
tribe on Tuesday, what would your name be? 

Three other short-answer adjunct questions were written on 
the remember-a-generality level and were inserted either before 
or after the passage for the respective treatments (RG pre 
questions and RG post questions). £.ich a question might ask, 
for example: How did Hkrumah's tribe name their children? 

The last three short-answer adjunct questions were written 
on the remcmber-an-instance level and were inserted either 
before or after the passage for the respective treatments (RI 
pre questions and P.I post questions). For example, such a 
question might ask: Does Nkrumah's name mean "Saturday"? 
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The nine short-anawer poattest queatlona were written on 
the thr^e perfornance levela (UG, RG, and RI) . The 
uae-a-generallty teat required atudenta to apply the generality 
to a new aituation. The remenber-a-generality teat required 
atudenta to recall the definition of the generality. And the 
renenber-an-inatance teat required atudenta to recall a 
apecific inatance of the generality. The adjunct queationa on 
the remember level (either RG or RI) were repeated in the 
poatteat, whereaa the queationa on the application level (UG) 
were different from the UG adjunct queationa which had been 
uaed during the inatruction. 



Six different treatment groups were uaed, with each group 
receiving adjunct questions which varied aa to performance 
level (RI, RG, UG) ana placement of the adjunct queationa (pre 
or poat) . Thua, the treatments can be repreaented aat 
Pre question Groups Poat question Groups 

1. Remember an inatance 4. Remember an inatance 

2. Remember a generality 5. Remember a generality 

3. uae a generality 6. Uae a generality 

In the pre question treatments, the atudenta were 
instructed to anawer the questions before turning ahead to the 
passage. They were then directed to read the paaaage once 
without turning back to the queationa, and to raiae their handa 
when they had finished reading. They were then given the 
poattest. In the post question treatments, the students were 
told to read the passage once, and then go to the next page. 
The students were then instructed to anawer the queationa 
without turning bacK to the passage, and to raise their hands 
when they had finished answering the questions. They were then 
given the posttest. 



Procedure 

The experiment took place during three consecutive class 
perioda (45 minutes each) in the morning at the West Hill High 
School, a auburban school in Syracuse, New York. The booklets, 
which contained the passage and the adjunct questions, were 
randomly passed out to students within each class. Then the 
students were instructed by the experimenter to read the 
directiona at the beginning of their booklets. The directiona 
explained that the purpose of the study waa to investigate how 
atudenta learned from written materials and how they used 
questions they encountered as they read. The directiona also 
explained that the aim of the atudy waa to enhance their 
learning by using good questions and inaerting them in auitable 
positions in the passage. Finally, the students were told that 
once they turned a page, they would tot be allowed to look back 
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at any previous pages* 



The students read the passage and answered the adjunct 
questions at their own pace. At the end of their booklets^ 
they were instructea to raise their hands for the posttest. 
The booklets had been numbered according to treatment groups. 
As each posttest was hanu&d out, it was given the same number 
as the treatment booklets so as to keep track of which test 
belonged to which treatment group. When the students completed 
their teut^ they were instructed to quietly read a book until 
the period was over. Tiie stuocnts were given 45 minutes to 
complete the passage^ answer the adjunct questions » and 
answering the posttest questions. Most of the students 
finished all of the above within 35 minutes^ and all finished 
within the 45 minute period. 



The test was comprised of items on three different levels 
of performance: remember-an-in8tance» remerober-a-generality, 
ana use-a-generality. The results were analyzed separately for 

«8fh tAiv^otfif ptiii'^isg^i.^^JagSei^fiyiJ^sa^ang^miffli'^gg 

results for the VG, the R0» and the RI subtests » respectively. 
Hone of the effects reached significance for any of these 
subtests. Uence» these results failed to support hypotheses 1 
and 2. 



Insert Tables I, 2, and 3 about here 



Table 4 summarizes the results for the total test scores. 
Only the interaction effect proved significant, P (2r58) «* 
3.14» {^x.OS. figure 1 illustrates this interaction. UG 
questions led to superior performance when they came after the 
relevant passage^ whereas RI questions led to superior 
performance when they came before the relevant passage. 
However^ there were no significant main effects on either type 
of adjunct questions, P (2»S8) « ,57, ^^.566, or position of 
adjunct questions, F (1,58) » .48, fi'>*.327. This result 
supported the hypothesis 3, but failed to support hypotheses 1 
and 2. 

Diacuaaion 

The results on each subtest (UG, RG. a.u KI) failed^ to 
support any of the hypotheses. This supports the results that 

Andre et al. (1980) found in five of their eight studies: that 
different ty;2fifi o£ adjunct questions have no localiz<?d effects 
on either application or remember level learning. It also 
indicates that differenc iiytait-inna of adjunct questions have no 
localized effects on either application or remember level 
learning. 
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supports hSpothesis 3 rS test 
more effective when th^v ari oi ?Jf"" '^S" questions are 
whereas the Dost oJ««?fo«» ! " gCBifimhPr level (ri or RG), 
the SLufiLSf leSef mcf" '"^f,f,««e"ive when they are 

•ttenuSn.^^'^^^SSf, tUT, «^ "selective 

Sir ihicS^re''%?rnij;?er\:"jH"*^'*'^^ 

1967)! tSJ e«J!Jat?f„^f! questions (Rothkopf and BiSblcoJ? 

questions. |iS;?ij;*'^SS ^" ^^^^^^ pJi 

content of the wSmSc thlt i^t l^r^'^J'^ different from the 

pre question!; ir":nii Jedicld^'SuJ'i'!«;?Jr"°" '""f^^**" 
explanation becaSse thev show .-JiJ concur with this 

effective when they were It ?h2 rt »?'f ^'"""onB wore more 
were at the UG levll PigS?e J)! ^^''^^^ ^'^^ ^^^^ 

»erve'T"!:el^i?^^^if?"\fS;S J^^^'/he passage, they cannot 
serve as to -Jef ?esS ^S! ?2l ^""f^ion, rather they can only 

questions, in SSJ oJSe? LJS"^"?^'"'^^ learning, go ^st 

different than tJS%n?J™ti5n wesJS^ed^fJ^Jh.T^'*^^"^ 
questions, therefor* «?«k.ki ®° ^" Passage. These 

memory in I lll^ll'^t IncturlLl'^l^l J** "^"^^ learner's 

information in tL p^8sl2^^"||Ser5fiif^a"?^o«^r 

signi?fLnS"on'"?Ji''S?in""e«2c?f '5'^ "'""^ ^^^^'^ 
subtests. This stud5?i i^fJf?Jf« f*"'*.®!*"^ *^»'e three 

does not mean ?S!t SuSh signiSiciici^rtiL""? ""f^ significance 
the small number of test itfmS ?Sf "2*^ exists, m fact, 

ijffe?2s?es ^"^^g^^co" ^ "'-^ sSb?:s?s^" r%%nst" 

be fe"& us?n'g^SrieJi^Jti:i!^«^^ ^'^^ s?u%^%ho'S?5 

optimJje l%%"Mn%'?";oJ'Sn!rSe''i^^^'%5r^""^ 
be taken into aicount in dlSfnif?? ?^ adjunct question should 
inserting those qSe2tioS« ?i^ ."^o^?f^5?"^**"' ^^^o that 
important. questions in a suitable position is also 
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Effect 


X • (S.D) N 


F 


df 


P 


Type 


U6 




RT 


.19 


(2,58) 


.83 


2.4.(.88).20 


2.39.{.50).23 


2.40(.64).21 


Position 


Before 


After 


.46 


(1.58) 


.50 


2.30, (.73). 33 


2.42. (.62). 31 


Type X 
Position 


U6 


RG 


RI 


UG 


RG 


RI 


1.90 


(2.58) 


.16 


2.10 

(.21) 
10 


2.42 
(.20) 
12 


2.36 
(.20) 
11 


2.70 
(.21) 
10 


2.36 
(.20) 
11 


2.20 
(.21) 
10 



Table 1. Means . standard deviations and number of students for the UG test . 
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Effect 



Type 



Position 



Type X 
Position 



IS.D) 



U6 



2.1. (l.t)2)i 20 



R6 



2.26, (.69) ,23 



Before 



2.18, (.84), 33 



1.80 
(.26 
10 



M. 



2.25 
(.24) 
12 



2.45 
(.25) 
11 



RI 



2.29, (.78), 21 



After 



2.26, ( .82), 31 



2.4 
(.26) 
10 



2.27 
(.25) 
11 



RI 



2.10 
(.26) 
10 



.36 



.15 



df 



(2.58) 



(1.58) 



1.71 



(2.58) 



Table '2. Means, standard deviation, and number of students for R6 test . 
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ERIC 



Effect 


T . (S D), N 


F 


df 


P 


Type 


U6 




RI 


1.4 


(2.58) 


.34 


1.8. (.83). 20 


2.0. (.80.23 


1.62. (.92). 21 


Position 


Before 


After 


.68 


(1.58) 


.41 


1.73, (.84), 33 


1.90. (87). 31 


Type X 
Position 


U6 


R6 


RI 


UG 


R6 


RI 


.87 


(2.58) 


.42 


1.60 
(.27) 
10 


1.B3 
(.25) 
12 


1.73 
(.26) 
11 


2.0 
(.27) 
11 


2.18 
(.26) 
11 


1.50 
(.27) 
10 



Table 3. 



Means, standard deviation, and number of students for RI test . 
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Efftct 



Type 



(S.O) , 



UG 



6.30. (1.87),20 



6.65» (1.40)»23 



RI 



6.19. (1.36)»21 



df 



.57 



(2,58) 



Position 



Type X 
Position 



Before 



6.21. (1.50). 33 



U6 



S.50 
(.47) 
10 



RG 



6.50 
(.43) 
12 



RI 



6755 
(.45) 
11 



After 



6.58. (1.59), 31 



UG 



7.10 
(.47) 
10 



RG 


RI 


6.82 


5.60 


(.45) 


(.47) 


•11 


10 



.98 



(1.58) 



3.14 



(2,58) 



Tah1^4. Nuns, standard deviation, and number of students for Total test. 
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3 



2 



1 



U6 



RG 



RI 



Figure* 1. 



Type of Question 

Interaction between type and positions of adjunct <juest1on on the total post test. 
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